This paper attempt to study the effectiveness of text representation schemes on two tasks namely: User Aggression and Fact Detection from the social media contents. In User Aggression detection, The aim is to identify the level of aggression from the contents generated in the Social media and written in the English, Devanagari Hindi and Romanized Hindi. Aggression levels are categorized into three predefined classes namely: `Non-aggressive`, `Overtly Aggressive`, and `Covertly Aggressive`. During the disaster-related incident, Social media like, Twitter is flooded with millions of posts. In such emergency situations, identification of factual posts is important for organizations involved in the relief operation. We anticipated this problem as a combination of classification and Ranking problem. This paper presents a comparison of various text representation scheme based on BoW techniques, distributed word/sentence representation, transfer learning on classifiers. Weighted $F_1$ score is used as a primary evaluation metric. Results show that text representation using BoW performs better than word embedding on machine learning classifiers. While pre-trained Word embedding techniques perform better on classifiers based on deep neural net. Recent transfer learning model like ELMO, ULMFiT are fine-tuned for the Aggression classification task. However, results are not at par with pre-trained word embedding model. Overall, word embedding using fastText produce best weighted $F_1$-score than Word2Vec and Glove. Results are further improved using pre-trained vector model. Statistical significance tests are employed to ensure the significance of the classification results. In the case of lexically different test Dataset, other than training Dataset, deep neural models are more robust and perform substantially better than machine learning classifiers.
Filter by Year
Filter by Author
P. D. Gujrati (8)
Manish Shrivastava (7)
Partha Pratim Roy (5)
Umapada Pal (5)
Ayan Kumar Bhunia (4)
Iti Mathur (4)
Manish Shrivastava (7)
Partha Pratim Roy (5)
Umapada Pal (5)
Ayan Kumar Bhunia (4)
Iti Mathur (4)
Nisheeth Joshi (4)
C.V. Jawahar (4)
Sahil Swami (3)
Dipak Kumar Basu (3)
Nibaran Das (3)
Dipak kumar Basu (3)
Akash Mohta (3)
Kamal Sarkar (3)
Ankush Khandelwal (3)
Pushpak Bhattacharyya (3)
Subhadip Basu (3)
Mita Nasipuri (3)
Mahantapas Kundu (3)
Ram Sarkar (3)
Richa Sharma (2)
Prakash B. Pimpale (2)
Sabir Ismail (2)
Nurendra Choudhary (2)
Shweta Nigam (2)
Bidisha Samanta (2)
MD. Saiful Islam (2)
Raj Nath Patel (2)
B.B. Chaudhuri (2)
Mohd Zeeshan Ansari (2)
Syed Sarfaraz Akhtar (2)
Md. Saiful Islam (2)
Rajat Singh (2)
U. Pal (2)
Rekha Jain (2)
P.J. Narayanan (1)
Dipti Mishra Sharma (1)
Devendra Sachan (1)
A. K. A. Azad (1)
Minhaz Uddin Ahmed (1)
P. P. Aung (1)
Vasudeva Varma (1)
Pramod Pandey (1)
Shashi Pal Singh (1)
S.S. Ravi Kiran (1)
Dipaloke Saha (1)
M. Kameswara Rao (1)
Deepti Chopra (1)
Ching Y. Suen (1)
Pawan Goyal (1)
M Rema (1)
Md. Nawab Yousuf Ali (1)
John Everatt (1)
Atul Kr. Ojha (1)
Tasmin Afroz (1)
Srikanth Ronanki (1)
Kaustubh Bhattacharyya (1)
Rajmohan Pardeshi (1)
Lukáš Neumann (1)
Sakshi Gupta (1)
Manju Manuel (1)
Preethi Jyothi (1)
Shrey Dutta (1)
Uma Shanker Tiwary (1)
S. Madhvanath (1)
Md. Shopon (1)
Shantipriya Parida (1)
M.N.S.S.K. Pavan Kumar (1)
Rohit Mishra (1)
Srikanth Doddamani (1)
Neeraj Battan (1)
Md Zahangir Alom (1)
Ashis Kumar Mandal (1)
Suman Banerjee (1)
S. Sphoorthy Reddy (1)
Anirudh Dahiya (1)
Akanksha Gehlot (1)
Sufal Das (1)
Somnath Roy (1)
Md Saddam Hossain (1)
Raveena R Kumar (1)
Nitish Joshi (1)
Sagar S. Rane (1)
Rajasree M S (1)
Bajibabu Bollepalli (1)
Mohit Jain (1)
Irina Temnikova (1)
K. C. Santosh (1)
Shaikh Muhammad Allayear (1)
T.S. Naveen (1)
Vivek Kr Verma (1)
Priya Rani (1)
Aditya Joshi (1)
ARUN K. PUJARI (1)
Peheding Sidike (1)
Girish Nath Jha (1)
Jiří Matas (1)
Ajai Kumar (1)
Kamlesh Sharma (1)
Md. Fahad Hasan (1)
Jahid Hassan (1)
Deepak Gupta (1)
Suranjit SinhaUmapada PalB. B. Chaudhuri (1)
Mallikarjun Hangarge (1)
Nicola Nobile (1)
M.B. SUKHASWAMI (1)
Rohit Sinha (1)
A. Hassan (1)
Rezwana Sharmeen (1)
Niloy Ganguly (1)
Nadir Durrani (1)
Osama Alsaad (1)
Siva Reddy (1)
Utpal Sharma (1)
Purnendu Banerjee (1)
P. SEETHARAMULU (1)
G Manoj Kumar (1)
Satya Ranjan Dash (1)
Bidyut B. Chaudhuri (1)
Ishita Bindlish (1)
Kandarpa Kumar Sarma (1)
Preslav Nakov (1)
Jasabanta Patro (1)
Stephan Vogel (1)
Bharath A (1)
Prithwish Mukherjee (1)
Rikta Sen (1)
Md. Hanif Seddiqui (1)
M. R. Amin (1)
Abdul Rahiman M (1)
Soumen Chakrabarti (1)
Nayan Jyoti Kalita (1)
Simon King (1)
Abdul Hannan (1)
Shahjalal Ahmed (1)
Mimisha Nesan (1)
Kalyanee Kanchan Baruah (1)
Shamim Ripon (1)
Pranjal Das (1)
Comma seperated list of Authors (1)
Sanjay Saha (1)
Sree Harsha Ramesh (1)
M S Rajasree (1)
Tanvir Ahmad (1)
Bradley P. Lambeth Jr (1)
Tushar Patnaik (1)
M Abdul Rahiman (1)
Arijit Mukherjee (1)
T. V. Prasad (1)
Siddhartha Arora (1)
Chun Lei He (1)
Syed S. Akhtar (1)
S. Padmavathi (1)
Ameya Prabhu (1)
Shabbir Ahmad (1)
Mahmudul Hasan (1)
Asif Ekbal (1)
Mirzanur Rahman (1)
Sushma Yalamanchili (1)
Sreelekha S (1)
Mitesh M. Khapra (1)
Arnav Sharma (1)
Md. Ataur Rahman (1)
R SaidasS. (1)
Vishwajeet Kumar (1)
Shrikant Malviya (1)
Saurabh Singh (1)
N Masha (1)
Souvik Bhowmick (1)
Amba P. Kulkarni (1)
Nitigya Sambyal (1)
Md. Rafiqul Islam (1)
Dipti M. Sharma (1)
Ondřej Bojar (1)
Shruti Tyagi (1)
Juhi Ameta (1)
Vinay Singh (1)
Monojit Choudhury (1)
Piyush Bansal (1)
Bilkis Jamal Ferdosi (1)
Nikita Moghe (1)
Ahmad Musleh (1)
Abhipsa Basu (1)
Vineet Chaitanya (1)
Pawanesh Abrol (1)
Amir Sadeghi (1)
Sudeshna Sarkar (1)
Manojna K. S. S (1)
Paheli Bhattacharya (1)
Prasenjit Majumder (1)
Tark M. Taha (1)
S. V. A. V. Prasad (1)
R Meenakshi (1)
Andrea Corsi (1)
Arpita Das (1)
Vijayan K. Asari (1)
N. Mohammed (1)
Evan Askanazi (1)
Rajeev Sangal (1)
Ganesh Ramakrishnan (1)
Shubham Tripathi (1)
Minesh Mathew (1)
Raveesh Motlani (1)
Vaishali Sharma (1)
Md. Abul Kalam Azad (1)
Manish Srivastava (1)
Shikha Kabra (1)
Shikhar Kr. Sarma (1)
Ritika Agarwal (1)
S. M. Kamruzzaman (1)
Baharul Islam (1)
M Sasikumar (1)
U. Pal ; B.B. Chaudhuri (1)
Sreelekha. S (1)
Avirup Bhattacharyya (1)
Md Arshad Ali (1)
Malik Waqas Sagheer (1)
Madan Gopal Jhanwar (1)
Radhika Mamidi (1)
D. Meenakshy (1)
Lubna Khan (1)
Sandip Modha (1)
N.V. Neeba (1)
Akshar Bharati (1)
Ankit Kumar (1)
Ganji Sreeram (1)
Anoop Namboodiri (1)
Animesh Mukherjee (1)
More
C.V. Jawahar (4)
Sahil Swami (3)
Dipak Kumar Basu (3)
Nibaran Das (3)
Dipak kumar Basu (3)
Akash Mohta (3)
Kamal Sarkar (3)
Ankush Khandelwal (3)
Pushpak Bhattacharyya (3)
Subhadip Basu (3)
Mita Nasipuri (3)
Mahantapas Kundu (3)
Ram Sarkar (3)
Richa Sharma (2)
Prakash B. Pimpale (2)
Sabir Ismail (2)
Nurendra Choudhary (2)
Shweta Nigam (2)
Bidisha Samanta (2)
MD. Saiful Islam (2)
Raj Nath Patel (2)
B.B. Chaudhuri (2)
Mohd Zeeshan Ansari (2)
Syed Sarfaraz Akhtar (2)
Md. Saiful Islam (2)
Rajat Singh (2)
U. Pal (2)
Rekha Jain (2)
P.J. Narayanan (1)
Dipti Mishra Sharma (1)
Devendra Sachan (1)
A. K. A. Azad (1)
Minhaz Uddin Ahmed (1)
P. P. Aung (1)
Vasudeva Varma (1)
Pramod Pandey (1)
Shashi Pal Singh (1)
S.S. Ravi Kiran (1)
Dipaloke Saha (1)
M. Kameswara Rao (1)
Deepti Chopra (1)
Ching Y. Suen (1)
Pawan Goyal (1)
M Rema (1)
Md. Nawab Yousuf Ali (1)
John Everatt (1)
Atul Kr. Ojha (1)
Tasmin Afroz (1)
Srikanth Ronanki (1)
Kaustubh Bhattacharyya (1)
Rajmohan Pardeshi (1)
Lukáš Neumann (1)
Sakshi Gupta (1)
Manju Manuel (1)
Preethi Jyothi (1)
Shrey Dutta (1)
Uma Shanker Tiwary (1)
S. Madhvanath (1)
Md. Shopon (1)
Shantipriya Parida (1)
M.N.S.S.K. Pavan Kumar (1)
Rohit Mishra (1)
Srikanth Doddamani (1)
Neeraj Battan (1)
Md Zahangir Alom (1)
Ashis Kumar Mandal (1)
Suman Banerjee (1)
S. Sphoorthy Reddy (1)
Anirudh Dahiya (1)
Akanksha Gehlot (1)
Sufal Das (1)
Somnath Roy (1)
Md Saddam Hossain (1)
Raveena R Kumar (1)
Nitish Joshi (1)
Sagar S. Rane (1)
Rajasree M S (1)
Bajibabu Bollepalli (1)
Mohit Jain (1)
Irina Temnikova (1)
K. C. Santosh (1)
Shaikh Muhammad Allayear (1)
T.S. Naveen (1)
Vivek Kr Verma (1)
Priya Rani (1)
Aditya Joshi (1)
ARUN K. PUJARI (1)
Peheding Sidike (1)
Girish Nath Jha (1)
Jiří Matas (1)
Ajai Kumar (1)
Kamlesh Sharma (1)
Md. Fahad Hasan (1)
Jahid Hassan (1)
Deepak Gupta (1)
Suranjit SinhaUmapada PalB. B. Chaudhuri (1)
Mallikarjun Hangarge (1)
Nicola Nobile (1)
M.B. SUKHASWAMI (1)
Rohit Sinha (1)
A. Hassan (1)
Rezwana Sharmeen (1)
Niloy Ganguly (1)
Nadir Durrani (1)
Osama Alsaad (1)
Siva Reddy (1)
Utpal Sharma (1)
Purnendu Banerjee (1)
P. SEETHARAMULU (1)
G Manoj Kumar (1)
Satya Ranjan Dash (1)
Bidyut B. Chaudhuri (1)
Ishita Bindlish (1)
Kandarpa Kumar Sarma (1)
Preslav Nakov (1)
Jasabanta Patro (1)
Stephan Vogel (1)
Bharath A (1)
Prithwish Mukherjee (1)
Rikta Sen (1)
Md. Hanif Seddiqui (1)
M. R. Amin (1)
Abdul Rahiman M (1)
Soumen Chakrabarti (1)
Nayan Jyoti Kalita (1)
Simon King (1)
Abdul Hannan (1)
Shahjalal Ahmed (1)
Mimisha Nesan (1)
Kalyanee Kanchan Baruah (1)
Shamim Ripon (1)
Pranjal Das (1)
Comma seperated list of Authors (1)
Sanjay Saha (1)
Sree Harsha Ramesh (1)
M S Rajasree (1)
Tanvir Ahmad (1)
Bradley P. Lambeth Jr (1)
Tushar Patnaik (1)
M Abdul Rahiman (1)
Arijit Mukherjee (1)
T. V. Prasad (1)
Siddhartha Arora (1)
Chun Lei He (1)
Syed S. Akhtar (1)
S. Padmavathi (1)
Ameya Prabhu (1)
Shabbir Ahmad (1)
Mahmudul Hasan (1)
Asif Ekbal (1)
Mirzanur Rahman (1)
Sushma Yalamanchili (1)
Sreelekha S (1)
Mitesh M. Khapra (1)
Arnav Sharma (1)
Md. Ataur Rahman (1)
R SaidasS. (1)
Vishwajeet Kumar (1)
Shrikant Malviya (1)
Saurabh Singh (1)
N Masha (1)
Souvik Bhowmick (1)
Amba P. Kulkarni (1)
Nitigya Sambyal (1)
Md. Rafiqul Islam (1)
Dipti M. Sharma (1)
Ondřej Bojar (1)
Shruti Tyagi (1)
Juhi Ameta (1)
Vinay Singh (1)
Monojit Choudhury (1)
Piyush Bansal (1)
Bilkis Jamal Ferdosi (1)
Nikita Moghe (1)
Ahmad Musleh (1)
Abhipsa Basu (1)
Vineet Chaitanya (1)
Pawanesh Abrol (1)
Amir Sadeghi (1)
Sudeshna Sarkar (1)
Manojna K. S. S (1)
Paheli Bhattacharya (1)
Prasenjit Majumder (1)
Tark M. Taha (1)
S. V. A. V. Prasad (1)
R Meenakshi (1)
Andrea Corsi (1)
Arpita Das (1)
Vijayan K. Asari (1)
N. Mohammed (1)
Evan Askanazi (1)
Rajeev Sangal (1)
Ganesh Ramakrishnan (1)
Shubham Tripathi (1)
Minesh Mathew (1)
Raveesh Motlani (1)
Vaishali Sharma (1)
Md. Abul Kalam Azad (1)
Manish Srivastava (1)
Shikha Kabra (1)
Shikhar Kr. Sarma (1)
Ritika Agarwal (1)
S. M. Kamruzzaman (1)
Baharul Islam (1)
M Sasikumar (1)
U. Pal ; B.B. Chaudhuri (1)
Sreelekha. S (1)
Avirup Bhattacharyya (1)
Md Arshad Ali (1)
Malik Waqas Sagheer (1)
Madan Gopal Jhanwar (1)
Radhika Mamidi (1)
D. Meenakshy (1)
Lubna Khan (1)
Sandip Modha (1)
N.V. Neeba (1)
Akshar Bharati (1)
Ankit Kumar (1)
Ganji Sreeram (1)
Anoop Namboodiri (1)
Animesh Mukherjee (1)